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(54) Solid state imaging device using differential detection method 



(57) Solid state imaging apparatus comprising first 
and second charge coupled devices (CCDs) (336a, 
336b), arranged as two charge accumulating circuits for 
a common photodiode (330). A light source illuminates 
the object to be imaged. A timing control circuit switches 
the light source on and off, and controls the transfer 



gates ,TG2) between the photodiode and the first 
and second CCD in such a way that the first CCD accu- 
mulates charges generated with the light source off, and 
the second CCD generates charges generated with the 
light source on. A differential amplifier (334) produces a 
difference signal, thereby eliminating the effect of any 
background light. 



FIG. 7 
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Description 

[0001] The present invention relates to a solid state 
imaging device and a solid state imaging apparatus in* 
eluding the former. 5 
[0002] Currently, a charge-coupled device (CCD) lin- 
ear sensor and a CCD image sensor are the two most 
popular solid state imaging devices. Generally, in a con- 
ventional CCD sensor of an interline-transfer type, a plu- 
rality of photo diodes, as light receiving elements, are 10 
arranged horizontally and vertically; a vertical scanning 
CCD shift register is prepared adjacent to and parallel 
with a column of corresponding vertically arranged pho- 
to diodes; and a serial output from the vertical scanning 
CCD shift register is inputted to a CCD in a horizontal 
scanning CCD shift register. 

[0003] Charges, i.e., photo-charges generated and 
accumulated in a process of photoelectric conversion 
by employing a photodiode, are transmitted to a corre- 
sponding adjacent vertical scanning CCD en bloc in re- 20 
sponse to a preset clock signal; and then the charges 
are progressively shift registered in. a corresponding 
vertical scanning CCD shift register by a preset sequen- 
tial clock signal. A serial charge output from the corre- 
sponding vertical scanning CCD shift register is fed to 25 
a horizontal scanning CCD shift register. The charges 
are progressively shift registered in the corresponding 
horizontal scanning CCD shift register in response to a 
preset sequential clock signal to thereby output a time 
series analog signal. 30 
[0004] In this conventional solid state imaging appa- 
ratus, e.g., a digital camera, employing such a solid 
state imaging device, there is prepared an electric or 
mechanical shutter for controlling an input of incident 
light to the solid state imaging device, wherein only dur- 35 
ing the period while the shutter is opened, the incident 
light is irradiated on photodiodes in the solid state im- 
aging device to thereby generate and accumulate 
charges. The incident light may include natural sunlight, 
light originated from a fluorescent or electric lamp arid 40 
light reflected from a subject. The incident light may fur- 
ther include light reflected from a supplementary light 
source such as the one used in a stroboscope. 
[0005] As is well known in the art, if the intensity of 
background light, e.g., due to natural sunlight, is too 45 
high, there may arise the so-called backlight phenome- 
non. In such event, an image for a subject becomes dark 
and unclear; and a boundary between a subject image 
and a background image becomes vague. In some cas- 
es, it is required that background image for a target sub- so 
ject be eliminated to obtain a clear image for the target 
subject. 

[0006] An undesired background image for the target 
subject can be eliminated through an image processing 
procedure by employing a computer. However, if the 55 
boundary between an image of the target subject and a 
background image thereof is unclear, it is difficult to elim- 
inate the background image properly. 



[0007] It is, therefore, an object of the present inven- 
tion to provide a solid state imaging device and a solid 
state imaging apparatus incorporating the device there- 
in for alleviating or eliminating the effect of background 
light stemming from, e.g., sunlight and/or an artificial il- 
lumination, thereby allowing a user to capture a clear 
image of a target subject. 

[0008] In accordance with one aspect of the present 
invention, there is provided a solid state imaging appa- 
ratus comprising: 

means for receiving an incident light to thereby gen- 
erate charges, the receiving means having one or 
more photoelectric conversion elements; 
first accumulation means, in response to a first con- 
trol signal, for accumulating the charges generated 
at each of the photoelectric conversion elements, 
the first accumulation means having one or more 
charge accumulation devices; 
second accumulation means, in response to a sec-, 
ond control signal, for accumulating the received 
charges generated from each of the photoelectric 
conversion elements, the second accumulation 
means having one or more charge accumulation 
devices; 

first transfer means for transferring the charges ac- 
cumulated in the first charge accumulation means 
in a serial sequence as a first charge signal; 
second transfer means for transferring charges ac- 
cumulated in the second charge accumulation 
means in a serial sequence as a second charge sig- 
nal; 

means for emitting light onto a target subject, 
wherein the intensity of the emitting light is control- 
lable; 

control means, based on a variation of the intensity 
of the emitted light, for outputting the first control 
signal or the second control signal to select the fist 
or the second charge accumulation means, thereby 
allowing the charges to be accumulated in the fist 
or the second charge accumulation means, respec- 
tively; and 

means for calculating a difference between the first 
charge signal and the second charge signal to 
thereby output a differential signal in sequence. 

[0009] In accordance with another aspect of the 
present invention, there is provided a solid state imaging 
device for use in a solid state imaging apparatus, the 
device comprising: 

means for receiving an incident light to thereby gen- 
erate charges, the receiving means having one or 
more photoelectric conversion elements; 
first accumulation means, in response to a first con- 
trol signal, for accumulating the charges generated 
from each of the photoelectric conversion elements, 
the first accumulation means having one or more 
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charge accumulation devices; 

second accumulation means, in response to a sec- 

ond control signal, for accumulating the received 

charges generated from each of the photoelectric 

conversion elements, the second accumulation 

means having one or more charge accumulation 

devices; 

first transfer means for transferring the charges ac- 
cumulated in the first charge accumulation means 
in a serial sequence as a first charge signal; 
second transfer means for transferring charges ac- 
cumulated in the second charge accumulation 
- means in a serial sequence as a second charge sig- 
nal; 

control means for outputting the first control signal 
or the second control signal to select the fist or the 
second charge accumulation means, thereby allow- 
■i ing the charges to be accumulated in the first or the 
.. second charge accumulation means, respectively; 

and means for calculating a difference between the 
% first charge signal and the second charge signal to 
thereby output a differential signal in sequence. 

[0010] The above and other objects and features of 
the present invention will become apparent from the fol- 
lowing description of preferred embodiments given with 
reference to the accompanying drawings, in which: 

Fig. 1 illustrates a schematic diagram of a bar code 
reader employing a solid state imaging apparatus 
in accordance with a first preferred embodiment of 
the present invention; 

Fig. 2 shows a structural diagram of a charge-cou- 
pled device (CCD) linear sensor illustrated in Fig. 1 ; 
Figs. 3A to 3H depict timing diagrams relating to the 
operation of the solid state imaging apparatus illus- 
trated in Fig. 1 ; 

Figs. 4A to 4C present diagrams for describing the 
operation of the solid state imaging apparatus illus- 
trated in Fig. 1 ; 

. Fig. 5 sets forth a structural diagram of a CCD linear 
sensor in accordance with a second preferred em- 

r bodiment of the present invention; 

.-.Figs. 6A to 6E reveal timing diagrams relating to the 
operation of a solid state imaging apparatus 
equipped with the CCD linear sensor set forth in Fig. 
5; 

v- Fig. 7 charts a structural diagram of a CCD linear 
sensor in accordance with a third preferred embod- 
iment of the present invention; 
Figs. 8A to 81 provide timing diagrams relating to 
the operation of a solid state imaging apparatus 
equipped with the CCD linear sensor shown in Fig. 
7; 

Fig. 9 represents a structural diagram of a CCD im- 
age sensor in a solid-state imaging apparatus in ac- 
cordance with a fourth preferred embodiment of the 
present invention; 



Fig. 1 0 offers a diagram of a camera having the solid 
state imaging apparatus equipped with the CCD im- 
age sensor represented in Fig. 9; 
Figs. 11 A to 11 C describe a situation of imaging a 
5 picture by employing the camera presented in Fig. 
10; 

Fig. 12 pictorializes a CCD image sensor in a solid- 
< state imaging apparatus in accordance with a fifth 
preferred embodiment of the present invention; 
10 Figs. 1 3A to 1 3H demonstrate exposure operations 
of a solid state imaging apparatus in accordance 
with a seventh preferred embodiment of the present 
invention; 

Figs. 14A to 14F exhibit timing diagrams relating to 
15 cases that duty ratios for the on-state of a light emit- 
ting source are 25% and 50% in accordance with a 
sixth preferred embodiment of the present inven- 
tion; and 

Fig. 15 displays an optical system in a solid state 
20 imaging apparatus in accordance with an eighth 
preferred embodiment of the present invention. 

[0011] . From now on, referring to Figs. 1 to 15, solid 
state imaging devices and solid state imaging appara- 

25 tuses in accordance with the preferred embodiments of 
the present invention, will be described. 
[0012] Fig. 1 illustrates a schematic diagram of a bar, * 
code reader 100 employing a solid state imaging appa- 
ratus 1 0 in accordance with a first preferred embodiment 

30 of the present invention. Fig. 2 shows a structural dia- 
gram of a charge-coupled device (CCD) linear sensor 
13 illustrated in Fig. 1. 

[0013] As illustrated in Fig. 1 , the bar code reader 100 
is provided with the solid state imaging apparatus 10 

35 and a signal processing circuit 15. The solid state imag- 
ing apparatus 1 0 includes a condensing lens system 1 1 , 
a light emitting source 12 emitting supplementary light 
L2 onto a subject (bar code) 1 , the CCD linear sensor 
1 3 converting an optical signal into an electric signal and 

40 a timing control circuit 1 4 controlling the operation of the 
light emitting source 12 and the CCD linear sensor 13. 
Generally, a high speed on/off device, e.g., an LED, is 
employed as the light emitting source 12. 
[0014] As shown in Fig. 2, the CCD linear sensor 13 

45 has a light receiving circuit 1 31 having a plurality of lin- 
early arranged photodiodes 1 30, a first CCD shift regis- 
ter 133A and a second CCD shift register 133B. Each 
of the CCD shift registers 133A and 133B acts as a 
charge accumulation circuit and a transfer circuit simul- 

50 taneously. The CCD shift registers 133A and 133B are 
arranged at right and left adjacent locations to the light 
receiving circuit 131, respectively. A first transfer gate 
1 32A and a second transfer gate 1 32B are provided be- 
tween the light receiving circuit 131 and the first CCD 

55 shift register 133A and the second CCD shift register 
133B, respectively. A differential amplifier 134 calcu- 
lates and outputs a differential signal V out between a se- 
rial . output (analog voltages) from the first CCD shift reg- 
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ister 133A and that from the second CCD shift register 
133B. 

[0015J Each of the first CCD shift register 1 33A and 
the second CCD shift register 133B contains a plurality 
of vertically arranged CCOs. An output from one photo- 
diode 130 in the light receiving circuit 131 is fed to a 
corresponding CCD in one of the first CCD shift register 
133A and the second CCD shift register 133B through 
the first transfer gate 1 32A and the second transfer gate 
132B, respectively. 

[0016] In the light receiving circuit 131, there is in- 
stalled an electric shutter (not shown in Fig. 2), wherein 
the light receiving circuit 131 is exposed to an incident 
light only during a period while the shutter is opened. In 
this case, the exposure time is controlled by an open- 
and-shut operation of the shutter. The shutting function 
corresponding to an electric shutter may also be 
achieved by eliminating accumulated charges in the 
light receiving circuit 131 just before the charge accu- 
mulation period thereof starts. 
[0017] Figs. 3A to 3H depict timing diagrams relating 
to the reading operation of the bar code reader 1 00 em- 
ploying the solid state imaging apparatus 10 illustrated 
in Fig. 1 . The CCD linear sensor 13 cannot execute an 
intermittent charge accumulation and a signal reading 
operation simultaneously since the CCD linear sensor 
1 3 functions not only as an accumulation circuit but also 
as a transfer circuit. 

[001 8] Hence, in a charge accumulation mode as de- 
picted in Fig. 3A, signal charges obtained by the light 
receiving circuit 131 are accumulated in each of the 
CCDs in the first CCD shift register 1 33A and the second 
CCD shift register 133B; and in a subsequent signal 
reading mode, the signal charges accumulated in each 
of the CCDs in the first CCD shift register 133A and the 
second CCD shift register 1 33B are shifted in time series 
to thereby read out a signal voltage therefrom. 
[001 9] The timing control circuit 1 4 provides an on/off 
control signal, e.g., the one depicted in Fig. 3B, to the 
light source emitting circuit 1 2. The light emitting source 
1 2 is opened to thereby emit light when the on/off control 
signal is 1 , i.e., during an exposure period of an on-state 
thereof (refer to Fig. 3C); and is closed when the on/off 
control signal is 0, i.e., during exposure periods of an 
off-state thereof (refer to Fig. 3D). In the charge accu- 
mulation mode, the timing control circuit 14 provides 
transfer timings TG1 andTG2 (referto Figs. 3E and 3F) 
in synchronization with the on and off operations of the 
light emitting source 12 to the first transfer gate 132A 
and the second transfer gate 132B, respectively. 
[0020] When the transfer timing TG1 is 1, charges 
generated at each photodiode 130 are fed to a corre- 
sponding CCD in the first CCD shift register 133 A 
through the first transfer gate 132A and then accumu- 
lated therein. When the transfer timing TG2 is 1 , charges 
generated at each photodiode 130 are fed to a corre- 
sponding CCD in the second CCD shift register 133B 
through the second transfer gate 132B and then accu- 
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mulated therein. TTirough these procedures, charges 
obtained in each of the photodiodes of the light receiving 
circuit 131 in accordance with continual or intermittent 
exposures thereof as shown in Figs. 3C and 3D are ad- 

5 ditionally accumulated in the first CCD shift register 
133A and the second CCD shift register 133B. 
[0021] As illustrated in Fig. 1, a subject 1 receives 
background light L1 of an artificial radiation lamp (not 
shown) and its reflective light L1 R is inputted to the lin- 

10 ear CCD sensor 1 3 through the condensing lens system 
1 1 . Further, while the light emitting source 1 2 is opened, 
emitted light 12 from the light emitting source 12 is re- 
flected at the subject 1 and then its reflected light L2R 
is also inputted to the linear CCD sensor 1 3 through the 

is condensing lens system 11 . In this case, a part of the 
background light L1 may be directly fed to the linear 
CCD sensor 13. 

[0022] Charges obtained at each photodiode 130 
from the incident lights L1 R and L2R are additionally ac- 

20 cumulated at each CCD of the first CCD shift register 
133A during exposure periods corresponding to an on- 
state of the light emitting source 12. Meanwhile; charges 
obtained at each photodiode 130 for the incident light 
L1 R are additionally accumulated at each CCD of the 

25 second CCD shift register 133B during exposure peri- 
ods corresponding to an off-state of the light emitting 
source 12. 

[0023] In a signal reading mode as depicted in Fig. 
3A, the timing control circuit 1 4 provides a signal reading 

30 timing SCK as shown in Fig. 3G to the first CCD shift 
register 133A and the second CCD shift register 1 33B. 
In the signal reading mode, since the first transfer gate 
1 32A and the second transfer gate 1 32B do not operate, 
charges from the light receiving circuit 1.31 are not trans- 

35 mitted to the first CCD shift register 133A and the sec- 
ond CCD shift register 133B. Instead, accumulated 
charges in each CCD thereof are shifted one by one ac- 
cording to each signal reading timing SCK and accord- 
inglyfedtothe differential amplifier 1 34. In this case, the 

40 signal reading timing SCK generally contains a plurality 
of, e.g., 2 to 4, clocks as shown in Fig. 3G to cause the 
shift registering of the accumulated charges one by one. 
[0024] The differential amplifier 134 calculates and 
outputs a differential signal between a first signal charge 

45 additionally accumulated during the exposure periods 
corresponding to an on-state of the light emitting source 
1 2 and a second signal charge additionally accumulated 
during the exposure periods corresponding to an off- 
state thereof. 

so [0025] Figs. 4A to 4C present diagrams for describing 
the operation of the solid state imaging apparatus 10 
illustrated in Fig. 1 . As illustrated in Fig. 4, since a signal 
charge corresponding to the incident light L1R is com- 
mon to the first CCD shift register 133A and the second 

55 CCD shift register 133B, a differential signal corre- 
sponding to the incident light L2R can be obtained by 
the differential amplifier 134. 
[0026] Accordingly, by using the solid state imaging 
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apparatus 10, the effect due to the background light L1 
is eliminated to thereby obtain a signal charge In time 
series corresponding to the emitted light L2 from the 
light emitting source 12 having a considerable light in- 
tensity. The signal processing circuit 15 performs data 
processing on this signal charge, i.e., the differential sig- 
nal from the differential amplifier 134 in the CCD linear 
sensor 13 to thereby obtain a clear image of a target 
subject, e.g., the bar code 1 , free from the backlight ef- 
fect. 

[0027] Fig. 5 sets forth a structural diagram of a CCD 
linear sensor 23 in accordance with a second preferred 
embodiment of the present invention. Figs. 6A to 6E re- 
veal timing diagrams relating to the operation of a solid 
state imaging apparatus equipped with the CCD linear 
sensor 23 set forth in Fig. 5. 

[0028] As shown in Fig. 5, the CCD linear sensor 23 
has a light receiving circuit 231 .having a plurality of lin- 
early arranged photodiodes, a transfer gate 232 and a 
CCD shift register 233 containing two CCDs, e.g., 233A 
and 233B, for one photodiode; e.g., a photodiode 230. 
The transfer gate 232 selectively transfers a charge 
from each photodiode, e.g., the photodiode 230 in the 
light receiving circuit 231 to one of the two CCDs, e.g., 
233 A and 233B. In other words, in a charge accumula- 
tion mode, in accordance with the transfer timings TG1 
and TG2, charges are alternatively transferred to the 
two CCDs designated by "a" and "b" as illustrated in Fig. 
5 and then additionally accumulated therein, respective- 
ly. 

[0029] In a signal reading mode, a signal reading tim- 
ing having a signal reading rate of two times that of the 
signal reading timing of the second preferred embodi- 
ment of the present invention is inputted to the CCD shift 
register 233 (refer to Fig. 6A). In response to this reading 
timing, charges are shifted in sequence in each CCD of 
the CCD shift register 233. Then output signals as 
shown in Figs. 6C and 6B from a final CCD 233B and a 
second final CCD 233A are generated, respectively. As 
a result, a differential amplifier 234 provides a differen- 
tial signal between the output from the CCD 233A and 
the output from the CCD.233B at every corresponding 
signal reading timing therefor. It should be noted that in 
the CCD linear sensor 23, since the transfer gate 232 
and the CCD shift register 233 are located at a same 
side with respect to the light receiving circuit 231, the 
chip area thereof becomes advantageously small. 
[0030] Fig. 7 shows a structural diagram of a CCD lin- 
ear sensor 33 in accordance with a third preferred em- 
bodiment of the present invention. Figs. 8A to 81 provide 
timing diagrams relating to the operation of a solid state 
imaging apparatus equipped with the CCD linear sensor 
33 set forth in Fig. 7. In the operation of the linear sen- 
sors 13 and 23, the charge accumulation mode and the 
signal reading mode are performed during two different 
time periods. But, in the CCD linear sensor 33, to cap- 
ture an image almost continuously, accumulation cir- 
cuits (a first CCD register 336A and a second CCD reg- 



ister 336B) and transf ercircuits (a first CCD shift register 
333A and a second CCD shift register) are prepared in- 
dependently by way of first and second signal reading 
gates 337A and 337B, respectively. 

5 [0031] After charges are accumulated in the first CCD 
register 336A and the second CCD register 336B in ac- 
cordance with an open-state and a shut-state of the light 
emitting source 12, respectively, the accumulated 
charges are transferred to the first CCD shift register 

10 333A and the second CCD shift register 333B through 
the first signal reading gate 337A and the second signal 
reading gate 337B when a reading gate transfer timing 
RG is applied to the first signal reading gate 337A and 
the second signal reading gate 337B, respectively. 

15 [0032] After the transmission of the accumulated 
charges, the first CCD register 336A and the second 
CCD register 336B restart to additionally accumulate 
charges. Meanwhile, the first CCD shift register 333A 
and the second CCD shift register 333B shift the charg- 

20 es accumulated therein in sequence in response to a 
corresponding signal reading timing SCK as illustrated 
in Fig. 8H. 

[0033] By employing the solid state imaging appara- 
tus equipped with the CCD linear sensor 33, an essen- 

25 tial continuous image can be captured to thereby sub- 
stantially reduce an unnecessary empty time interval (e. 
g., an interval between adjacent signal modes shown in 
Fig. 3A) between subsequent image captures. 
[0034] It should be noted that, in the above preferred 

30 embodiment, a linear sensor is used as a solid state im- 
aging device included in a solid state imaging appara- 
tus, but an image sensor can be used instead as a solid 
state imaging device.. Fig. 9 represents a structural dia- 
gram of a CCD. image sensor 43 in a solid-state imaging 

35 apparatus in accordance with a fourth preferred embod- 
iment of the present invention. In Fig. 9, control signal 
lines are omitted for simplicity. 
[0035] As represented in Fig. 9, the CCD linear sensor 
43 has a light receiving circuit 431 containing a plurality 

40 of photodiodes 430 arranged vertical fy and horizontally. 
Similar to the structure of the linear sensor 13 depicted 
in Fig. 2, a first CCD shift register 433 A and a second 
CCD shift register 433B (hereinafter referred to as ver- 
tical CCD shift registers) are vertically arranged at right 

45 and left locations of the light receiving circuit 431 , re- 
spectively. A first transfer gate 432A and a second trans- 
fer gate are provided between the light receiving circuit 
431 and the first vertical CCD shift register 433A and 
the second vertical CCD shift register, respectively, as 

so represented in Fig. 9. 

[0036] A serial output from each first vertical CCD shift 
register is inputted to each of the CCDs in a first hori- 
zontal CCD shift register 434A. A serial output from each 
second vertical CCD shift register is inputted to each of 

55 the CCDs in a second horizontal CCD shift register 
434B. Outputs from the first horizontal CCD shift register 
434A and the second horizontal CCD shift register 4348 
are fed to first and second input ports of a differential 
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amplifier 435, respectively. 

[0037] The structures and functions of the light receiv- 
ing circuit 431 , the first transfer gate 432A and the sec- 
ond transfer gate 432 B, the first vertical CCD shift reg- 
ister 433A and the second vertical CCD shift register 
4338 in the image sensor 43 are the same as those of 
corresponding circuits in the CCD linear sensor 13, re- 
spectively. 

[0038] Specifically, in a charge accumulation mode, 
charges obtained at each photodiode 430 during expo- 
sure times corresponding to an on-state and an off-state 
of a light emitting source (not shown) in the image sen- 
sor 43 are fed to corresponding CCDs in the first vertical 
CCD shift register 433A and the second vertical CCD 
shift- register 433H through the first transfer gate 432A 
and the second transfer gate 432B, respectively. 
[0039] In a signal reading mode, in response to a sig- 
nal reading timing, charges accumulated in each of the 
CCDs in the first vertical CCD shift register 433A and 
the second vertical CCD shift register 433B are fed to 
the first horizontal CCD shift register and the second 
horizontal CCD shift register 4348, respectively. Charg- 
es additionally accumulated in the first horizontal CCD 
shift register 434A and the second horizontal CCD shift 
register 434B are fed to the first and the second input 
ports of the differential amplifier 435, respectively. The 
differential amplifier 435 outputs a differential signal 
charge between the first signal charge and the second 
signal charge in time series. 

[0040] Fig. 10 offers a diagram of a camera having a 
solid state imaging apparatus 40 equipped with the CCD 
image sensor 43 represented in Fig. 9. Figs. 1 1 A to 1 1 C 
provide schematic diagrams explaining a situation of im- 
aging a picture by employing the camera presented in 
Fig. 10. The structure of the camera is basically the 
same as that of the bar code reader 100 in Fig. 1 . An 
image processing circuit 45 of the camera processes a 
pixel signal obtained by using the solid state imaging 
apparatus 40 to thereby form an image. Figs. 11 A and 
1 1 B illustrate exemplary pictures 5a and 5b based on 
signal charges obtained during corresponding periods 
of an on-state and an off-state of a light emitting source, 
respectively. It should be noted that these images are 
not outputted in a real situation. 
[0041] Referring to Fig. 10, since the travel distance 
of light from the light emitting source 42 is relatively 
short, the light therefrom cannot reach a far background 
object 3 with a considerable intensity while the light 
therefrom can reach a near target subject 2. As a result, 
the reflected light L2R from the target subject 2 during 
the on-state of the light emitting source 42 is substan- 
tially different from that during the off-state thereof. For 
this reason, referring back to Figs. 11 A to 11C, in a pic- 
ture 5c obtained based on an output signal from a CCD 
image sensor 43, a clear image for the target subject 2 
can be captured without an image interface 3b of the 
background object 3. 

[0042] It should be noted that various modifications of 



the CCD image sensor 43 are possible as in the case 
oftheCCD linear sensor 13. Fig. 12 describes a diagram 
of a modified CCD image sensor in accordance with a 
fifth preferred embodiment of the present invention. In 

5 Fig. 12, one differential amplifier 535 is provided for a 
pair of two vertical lines, i.e., a first CCD shift register 
533A and a second CCD shift register 533B. An output 
voltage from each differential amplifier 535 is outputted 
at a horizontal CCD shift register 534 in sequence. It 

10 should be noted that those who skilled in the art can eas- 
ily utilize the CCD linear sensor shown in Fig. 5 or Fig. 
7 as the modified CCD image sensor. 
[0043] In the solid state imaging apparatus 1 0 shown 
in Fig. 1 , the image for the target subject 1 is getting 

'5 clearer as the intensity of the light from the light emitting 
source 12 increases. The light emitting intensity thereof 
becomes strong as a corresponding input power in- 
creases. But there is a limitation in increasing the cor- 
responding input power per a preset unit time when a 

20 light-emitting diode (LED) or semiconductor laser is uti- 
lized as the light emitting source 12. 
[0044] Namely, within the preset unit time, the light in- 
tensity should be decreased if the light emitting time is 
increased. In the above-mentioned first to fifth preferred 

25 embodiments, a duty ratio for on -state of each of the 
light emitting sources 1 2 and 42 has been set as 50%. 
But, if this duty ratio for the on-state thereof becomes 
less than 50%, i.e. , if the on-state becomes shorter than 
the off-state thereof, the light emitting intensity during 

30 the on-state can be increased. 

[0045] Figs. 1 4A to 14F exhibit timing diagrams relat- 
ing to cases when duty ratios for the on-state of a light 
emitting source are 50% (refer to Figs. 14A and 14C) 
and 25% (refer to Figs. 14D and 14F), respectively, in 

35 accordance with a sixth preferred embodiment of the 
present invention. As shown in Fig. 14A, when the duty 
ratio thereof is 50%, it is desirable that the exposure be 
fully maintained during the time interval corresponding 
to each of the on-state and off-state thereof. 

40 [0046] When the duty ratio thereof is 25% as exhibited 
in Fig. 14D, it is desirable that the exposure be fully 
maintained during the time interval corresponding to the 
on-state thereof while the exposure is maintained during 
only a part of the time interval corresponding to the off- 

^5 state thereof. When the duty ratio is small, e.g., 25%, it 
Js desirable to increase the light emitting intensity. By 
increasing the light emitting intensity, during the expo- 
sure time of the on-state thereof, a ratio between the 
charge amount corresponding to the radiation light and 

50 the charge amount corresponding to the background 
light can be relatively large. Hence, in this case, if the 
effect due to the background light is regarded as a noise, 
a signal to noise (S/N) ratio thereof is improved. 
[0047] In each of the above-mentioned preferred em- 

55 bodiments, an exposure during an on-state thereof and 
that during an off-state thereof are executed alternative- 
ly. Figs. 13A to 13H demonstrate exposure operations 
in accordance with a seventh preferred embodiment of 
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the present invention. The exposure during an off-state 
thereof is not necessarily executed continually but can 
be performed en bloc (refer to Fig. 13D) while the expo- 
sure during an on-state thereof is needed to be executed 
continually as illustrated in Fig. 13C. 
[0048] In detail, during a charge accumulation period, 
on/off operations are repeated continually within the ac- 
cumulation period (refer to Figs. 13Aand 13B) and then 
charges obtained during on-states thereof are addition- 
ally accumulated (refer to Figs. 13C and 13E). Thereaf- 
ter, the exposure operation during an exposure time pe- 
riod within the off-state thereof is performed (refer to 
Figs. 1 3D and 1 3F). In this case, the total exposure time 
during the on-state thereof is designed to be substan- 
tially equal to the exposure time during the off-state 
thereof. 

[0049] Generally, a light receiving device or a CCD is 
formed on a one semiconductor chip to obtain a required 
property. Since, however, there may be a property dif- 
ference among the light receiving devices, even when 
the exposure time during the on-state thereof is equal 
to that during the off -state thereof, signal charges due 
to the background light for the first and the second CCD 
shift register (e.g., signal charges due to the background 
light L1 R in Fig. 4) may be different from each other. 
[0050] In this case, in an output signal from a corre- 
sponding differential amplifier, a signal due to the back- 
ground light is not fully cancelled to thereby rendering it 
difficult to delineate between the background object and 
the target subject. Forthis reason, therefore, it is needed 
that the exposure time during the off-state thereof be a 
little bit (e.g., over a number of percents) longer than 
that during the on-state thereof. With this method, the 
effect due to the background light can be fully cancelled 
even when the efficiency thereof during the on-state is 
a little bit higher than that during the off-state. 
[0051] In accordance with the fourth preferred em- 
bodiment of the present invention, in addition to obtain- 
ing a differential signal between accumulated charges 
during the on-state and those during the off-state there- 
of, capturing an image with the backlight effect is also 
possible. 

[0052] For example, in Fig. 2, if a transfer timing TG2 
is not inputted therein or the differential amplifier is con- 
trolled to be operated in an additional operation to 
render the accumulated charge during the off-state to 
be zero, an image capture with the backlight effect is 
also possible. 

[0053] In each of the solid state imaging apparatuses 
shown in Figs. 1 and 9, if the light emitting source is a 
white light source, black-and-white image data are ob- 
tained by using the CCD linear sensor or the CCD image 
sensor in accordance with the present invention. If the 
light emitting source is a monochromatic light source, e. 
g., a red or blue light source, corresponding colored re- 
flective image data are obtained. 
[0054] Therefore, in accordance with the present in- 
vention, the solid state imaging apparatus to obtain 



colored image data can be prepared by employing ap- 
propriate charge accumulation circuits and transfer cir- 
cuits corresponding to the three primary lights, i.e., red, 
blue and green light, in detail, there are two methods to 
5 obtain colored image data. From now on, these two 
methods applied on the solid state imaging apparatus 
will be described. 

[0055] In a first method, the light emitting source 12 
is prepared to have three colored light emitting ele- 

io ments, e.g., LEDs, to emit red, blue and green light, re- 
spectively; and for one light receiving circuit 131 , a set 
of three CCD shift registers are prepared to accumulate 
charges when each of the colored light elements is 
opened and shut, respectively. 

15 [0056] Three colored light emitting elements are 
opened, i.e., turned on, in sequence and then a corre- 
sponding CCD shift register for each colored light emit- 
ting element additionally accumulates charges while a 
corresponding colored light emitting element is under 

20 the on-state thereof and another corresponding CCD 
shift register for each colored light emitting element ac- 
cumulates charges additionally while all the colored light 
emitting elements are under the off-state thereof. As a 
result, for each of the three colored lights, there is ob- 

25 tained a differential signal between charges accumulat- 
ed during the on-state and those during the off-state 
thereof. 

[0057] In this case, the white balance controlling 
therefor can be preferably performed by accommodat- 

30 ing a driving current or an exposure time for each color- 
ed light emitting element. The charge obtained during 
the off-state thereof can be commonly utilized in obtain- 
ing a differential signal of accumulated charges for each 
colored light regardless of the kind of colored lights. 

35 Hence, three CCD shift registers for charge accumula- 
tion corresponding to one exposure time period may be 
sequentially connected to the light receiving circuit 131 . 
An accumulated charge in one CCD shift register corre- 
sponding to one exposure time period may be common- 

40 |y employed to obtain a corresponding differential signal 
for each of the colored lights. 
[0058] In a second method, CCDs equipped with color 
filters are used. Three primary light emitting elements, 
i.e., red, blue and green light emitting elements, or a 

45 white light emitting source having the three primary light 
emitting elements may be prepared as the light emitting 
source 12. During an exposure time of an on-state for 
this kind of light emitting source, the light receiving cir- 
cuit 1 31 receives the light emitted from the light emitting 

so source 1 2 and then transfers charges generated therein 
to the CCD shift registers equipped with color filters pre- 
pared corresponding to the colored lights, respectively. 
[0059] In this case, contrary to the first method, the 
exposure thereof can be executed simultaneously and 

55 the white balance controlling thereof can be preferably 
performed by accommodating a temperature of a corre- 
sponding colored light emitting element. For example, 
obtaining white light through the combination of three 
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primary lights is possible by accommodating a driving 
current or an exposure time for each corresponding 
LED. 

[0060] Further, to read characters in a picture (e.g., a 
picture of a license plate of a car), full color image is not 5 
necessarily needed. For example, in this case, through 
the combination process employing at least two light . 
emitting elements having different wave lengths as de- 
scribed above, information for two or more colors there- 
of can be interpreted to thereby obtain a corresponding io 
color picture image as well as luminance information 
therefor. This method is advantageously utilized to en- 
hance the image processing efficiency. 
[0061] As an example of an application of a solid state 
imaging apparatus of the present invention, there is a is 
reading device of a license plate of a car. When an im- 
age for a license plate of a car is considerably dark with 
respect to the main body or a light emitting source such 
as a headlight thereof, a conventional solid state imag- 
ing apparatus cannot obtain a sufficiently clear image to 20 
discriminate characters in the license plate since the ex- 
posure controlling in the conventional solid state imag- 
ing apparatus is performed only to reduce the exposure 
amount thereof. 

[0062] On the other hand, in the solid state imaging 25 
apparatus in accordance with the present invention, the 
radiation of the light emitting source can be controlled 
in such a way that it can be prevented from overflowing 
when the background light intensity reaches a maximum 
value to thereby suppress the generation of a shadow 30 
for the license plate. 

[0063] Accordingly, a clear image of a license plate of 
a car can be obtained by reducing or eliminating the in- 
fluence due to natural sunlight and/or headlight of the 
car to thereby greatly reduce the likelihood of misread- 35 
ing of the license plate. The solid state imaging appara- 
tus of the present invention can be utilized in other ap- 
plications. For example, exposure timing can be control- 
led in synchronization with pictures having periodical 
characteristics such as a picture of a television signal to *o 
thereby extract desired pictures. 
[0064] An auto-focusing circuit equipped with a pint 
detection device employing a CCD sensor in a conven- 
tional one-eyed reflex camera cannot focus a target sub- 
ject image on a white wall. But, by using the solid state 45 
imaging apparatus of the present invention, the effect 
due to a backlight can be cancelled to thereby focus a 
target subject image on a white wall satisfactorily even 
when the reflective light is strong. 
[0065] Fig. 1 5 displays a modified optical system in a 50 
solid state imaging apparatus in accordance with an 
eighth preferred embodiment of the present invention. 
In this modified optical system, by employing a half mir- 
ror 47, the lens 41 functions not only as a lens to receive 
light from outside and then focus the light to the CCD 55 
image sensor 43, but also as a lens through which the 
light passes from the light emitting source 42 onto a tar- 
get subject 2. With this configuration, since the radiation 



onto the target subject 2 and reception of the light there- 
from is performed along an almost same line as shown 
in Fig. 15, a clear image of the target subject 2 can be 
advantageously obtained without a shadow image 
thereof. 

[0066] In view of the foregoing, by employing a solid 
state imaging device and a solid state imaging appara- 
tus in accordance with the present invention, the effect 
due to a background light from a background object can 
be greatly reduced or removed to thereby obtain a clear 
image of a target subject. Accordingly, by using the solid 
state imaging device and the solid state imaging appa- 
ratus of the present invention, the discriminative image 
capturing capability for a target subject can be greatly 
enhanced. 

[0067] While the present invention has been de- 
scribed with respect to certain preferred embodiments 
only, other modifications and variations may be made 
without departing from the scope of the present inven- 
tion as set forth in the following claims. 
[0068] The features disclosed in the foregoing de- 
scription, in the claims and/or in the accompanying 
drawings may, both separately and in any combination 
thereof, be material for realising the invention in diverse 
forms thereof. 



Claims 

1 . A solid state imaging apparatus comprising: 

means for receiving an incident light to thereby 
generate charges, the receiving means having 
one or more photoelectric conversion ele- 
ments; 

first accumulation means, in response to a first 
control signal, for accumulating the charges 
generated at each of the photoelectric conver- 
sion elements, the first accumulation means 
having one or more charge accumulation de- 
vices; 

second accumulation means, in response to a 
second control signal, for accumulating the re- 
ceived charges generated from each of the 
photoelectric conversion elements, the second 
accumulation means having one or more 
charge accumulation devices; 
first transfer means for transferring the charges 
accumulated in the first charge accumulation 
means in a serial sequence as a first charge 
signal; 

second transfer means for transferring charges 
accumulated in the second charge accumula- 
tion means in a serial sequence as a second 
charge signal; 

means for emitting light onto a target subject, 
wherein the intensity of the emitting light is con- 
trollable; 
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control means, based on a variation of the in- 
tensity of the emitted light, for outputting the 
first control signal or the second control signal 
to select the first or second charge accumula- 
tion means, thereby allowing the charges to be 5 
accumulated in the first or the second charge 
accumulation means, respectively; and 
means for calculating a difference between the 
first charge signal and the second charge signal 
to thereby output a differential signal in se- w 
quence, 

2. The solid state imaging apparatus of claim 1, 
wherein each charge accumulation device in the 
first accumulation means and the second accumu- '5 
lation means is prepared for each corresponding 
photoelectric conversion element. 

3. The solid state imaging apparatus of claim 1, 
wherein said light emitting means is operated either 20 
in an on-state or in an off-state thereof; and said 
control means outputs the first control signal and 

the second control signal during the on-state and 
the off-state of said light emitting means, respec- 
tively. 25 

4. The solid state imaging apparatus of claim 1, 
wherein the charges accumulated in the first and 
the second accumulation means are fed en bloc to 
the first and the second transfer means, respective- 30 
ly; the first and the second transfer means transfer 
the charges in series; and at the same time, the first 
and the second accumulation means accumulate 
the charges. 

35 

5. The solid state imaging apparatus of claim 3, 
wherein the first accumulation means additionally 
accumulates pharges obtained during a continued 
on-state of the light emitting means and then trans- 
fers the obtained charges. 40 

6. A solid state imaging device for use in a solid state 
imaging apparatus, the device comprising: 

means for receiving an incident light to thereby 45 
generate charges, the receiving means having 
one or more photoelectric conversion ele- 
ments; 

first accumulation means, in response to a first 
control signal, for accumulating the charges 50 
generated from each of the photoelectric con- 
version elements, the first accumulation means 
having one or more charge accumulation de- 
vices; 

second accumulation means, in response to a 55 
second control signal, for accumulating the re- 
ceived charges generated from each of the 
photoelectric conversion elements, the second 



accumulation means having one or more 

charge accumulation devices; 

first transfer means for transferring the charges 

accumulated in the first charge accumulation 

means in a serial sequence as a first charge 

signal; 

second transfer means for transferring charges 
accumulated in the second charge accumula- 
tion means in a serial sequence as a second 
charge signal; 

control means for outputting the first control sig- 
nal or the second control signal to select the 
first or the second charge accumulation means, 
thereby allowing the charges to be accumulat- 
ed in the first or the second charge accumula- 
tion means, respectively; and 
means for calculating a difference between the 
first charge signal and the second charge signal 
to thereby output a differential signal in se- 
quence. 

7. The solid state imaging device of claim 6, wherein 
each charge accumulation device in the first accu- 
mulation means and the second accumulation 
means is prepared for each corresponding photoe- 
lectric conversion element. 

8. The solid state imaging device of claim 6, wherein 
said light emitting means is operated either in an 
on-state or in an off-state thereof; and said control 
means outputs the first control signal and the sec- 
ond control signal during the on-state and the off- 
state of said light emitting means, respectively. 

9. The solid state imaging device of claim 6, wherein 
the charges accumulated in the first and the second 
accumulation means are fed en bloc to the first and 
the second transfer means, respectively; the first 
and the second transfer means transfer the charges 
in series; and at the same time, the first and the sec- 
ond accumulation means accumulate the charges 
therein. 

10. The solid state imaging device of claim 8, wherein 
the first accumulation means additionally accumu- 
lates charges obtained during a continued on-state 
of the light emitting means and then transfers the 
obtained charges. 

11. A solid state imaging apparatus comprising: 

means having one or more photoelectric con- 
version elements for receiving an incident light 
and then generating charges; 
first accumulation means having one or more 
charge accumulation devices, in response to a 
first control signal, for accumulating the charg- 
es generated at each of the photoelectric con- 
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version elements and then transferring the ac- 
cumulated charges in a serial sequence as a 
first charge signal; 

second accumulation means having one or 
more charge accumulation devices, in re- s 
sponse to a second control signal, for accumu- 
lating the received charges generated at each 
of the photoelectric conversion elements and 
then transferring the accumulated charges in a 
serial sequence as a first charge signal; 10 
means for emitting light onto a target subject, 
the intensity of the light being controlled to be 
varied; . 

control means, based on a variation of intensity 
of the emitted light, for outputting the first con- is 
trol signal or the second control signal to select 
the first or the second charge accumulation 
means, thereby allowing the charges to be ac- 
cumulated in the first or the second charge ac- 
cumulation means, respectively; and 20 
means for calculating a difference between the 
first charge signal and the second charge signal 
to thereby output a differential signal in se- 
quence, 

wherein in each of the first and the second ac- 25 
cumulation means, the charge accumulation 
operation and the transfer operation are per- 
formed during different time periods from each 
other. 



35 



40 



45 



50 



55 



10 




EP 1 102 324 A1 



FIG.1 



100 




15. 



Z 



SIGANL 
PROCESSING 



FIG. 2 



13 



I 



133B-^ 




oTG2 
oTGl 
oSCK 



- ^- 133A 



132B ^ 132A 




Voor 



11 



EP 1 102 324 A1 



§ 



1 



8 



s 



E 



1 




E 



'WA 



WA 



WA 



WA 



WA 



WA 



V//A 



WA 



WA 



WA 



WA 



WA 



WA 



DC 



O 

'o 
e 
e 
o 
o 



o 
o 

9 
O 
O 
O 




1C 



CM 



§ 

2 



o 
o 

k 

o 



CO 

Q 

Q 



i 

o 

b 



1 ill 




CO 00 











CO 


CO 


CO 




FIG. 


FIG. 











CO CO 



12 



EP1 102 324 A1 



FIG. 4A 



SIGNAL 
CHARGE 
FOR INCIDENT 
LIGHT L1R 



SIGNAL 

CHARGE 
FOR INCIDENT 
LIGHT L2R 



OUTPUT OF 

FIRST CCD 

SHHT* 
REGISTER 



FIG. 4B 



i 

i 



SIGNAL 
CHARGE 
FOR INCIDENT 
LIGHT LIE 



i 

i 

• J 



SECOND 

CCD SHIFT 
REGISTER 



FIG. 4C 



i 
i 



i 
i 

i 

♦ 



SIGNAL 
CHARGE 
FOR INCIDENT 
LIGHT L2R 



OUTPUT OF 
DIFFERENTIAL 

AMPLIFIER 



13 



EP 1 102 324 A1 



FIG. 5 

23 



OTG2 
oTGl 



a 



□ 



i 

• : 



q 



± 



230 232 



U233 



7 
233B 



B 




14 



EP 1 102 324 A1 



<T5 
1*3 



51 

01 



to 



2 



s 2 
i 



o 



"I 



CO 

I 



I 

I 

i 




I 

cr 




to 
i 

or 
to 





er 

CO 



CO 




0) 



to 



a* 




15 



EP 1 102 324 A1 
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